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Appendix A. About the study 


Prior research, particularly for the United States, has shown that earning a community college credential increases 
an individual’s likelihood of gaining stable employment, earning a living wage, and working in a higher-paying job 
than in a job that requires only a high school diploma (Minaya & Scott-Clayton, 2017). Research on early college 
success and college completion in the Republic of Palau has been limited, however. There is some evidence that 
Palau High School students might not be adequately prepared for success when they enter college, as the 
graduation rate from Palau Community College within three years is low (National Center for Education Statistics, 
2020). The current study is intended to increase Palau Community College administrators’ and educators’ 
understanding of the factors associated with early college success and college completion by describing the high 
school academic preparation variables and other student characteristics of students in Palau who achieved early 
college success and completed college. 


Data from the 2015 Census of Population, Housing, and Agriculture for Palau reveal that 78 percent of adults ages 
25 and older graduated from high school or earned a high school equivalency credential, and 29 percent earned 
a college degree of some type (Republic of Palau Bureau of Budget and Planning, 2015). Improving college 
completion rates is considered a priority for further success in Palau; as Palau’s Workforce Innovation and 
Opportunity Act plan states, “every Palauan needs at least a high school diploma or equivalent to succeed, and, 
in reality, will need skills and educational attainment that go beyond high school graduation” (U.S. Department of 
Education, 2015). 


This appendix summarizes the research base used in developing this study. Prior research, most of it in the United 
States, might be only partially applicable to Palau because its education system and student population differ 
substantially from those of the United States. Despite that limitation, the current study identified college success 
outcomes and academic preparation and student characteristic variables of interest based on the research 
literature. 


Community college outcomes 

Achievement in college courses, as measured by grade point average, is regularly used as a tool to assess students’ 
college success in the United States (Adelman, 1999; Cabrera et al., 2003; Chen & Carroll, 2005; DesJardins et al., 
2002; Herzog, 2005; Moore & Shulock, 2009). Of particular interest to this study is Herzog’s (2005) finding that 
students' grade point average in their first year of college predicted their persistence to a second year of college 
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enrollment and to degree completion in the United States. The current study used earning a grade point average 
of 2.0 or higher as a binary outcome (yes/no) representing early college success, as Palau Community College 
requires students to maintain a grade point average of 2.0 or higher to earn a credential or degree (Palau 
Community College, n.d. a, b, c, d). 


Research in the United States has found that students are most likely to drop out of college in their first or second 
year (Bradburn, 2002; Horn, 1998; Stephan et al., 2015). Likewise, students who persist past their first year are 
significantly more likely to complete a college degree (Horn, 1998). For example, Bradburn (2002) found that 
among students who enrolled in public two-year institutions in the United States, 44 percent left within three 
years without a credential: 24 percent in the first year, 13 percent in the second year, and 7 percent in the third 
year. Additionally, Crosta (2014) found a strong positive relationship between continuous enrollment and 
credential completion. The current study examined the extent to which these trends are also found in Palau, using 
completion of an associate degree or a certificate within three years of first enrollment in Palau Community 
College as one of the success outcomes of interest. This metric was selected because more than half of students 
who complete a degree at a two-year institution in the United States take longer than two years on average to 
finish their degree (Horn, 2010). The three-year graduation rate thus seemed to be an appropriate metric to assess 
college completion rates among Palau High School graduates. 


High school academic preparation 


Prior studies in the United States identify several high school academic preparation variables as predictive of early 
college success or college completion. For example, earning credit in higher-level math courses in high school has 
been shown to be associated with college success outcomes, including college completion (Adelman, 2006; Jonas 
et al., 2012). Algebra is termed a “gateway” course, with successful completion earlier in a student’s academic 
career better preparing him or her for later success in school (Matthews & Farmer, 2008; Walston & McCarroll, 
2010). Additionally, completing Algebra | in an early grade allows students more time to enroll in higher-level math 
courses. However, simply requiring more higher-level math courses and enrolling more students in Algebra | 
earlier in their academic careers are not enough to yield positive results. Research in the Northern Mariana Islands 
suggests that proper student supports are also important and that requiring an additional year of math, if 
accompanied by proper student supports, could increase the number of high school students prepared for college 
coursework when they enter college (Herman et al., 2017). 


High school grade point average has also been identified as a reliable predictor of college success outcomes in the 
United States, including first-year college grades (Geiser & Santelices, 2007; Noble & Sawyer, 2002), cumulative 
college grades, and college completion (Geiser & Santelices, 2007). A study of more than 60,000 community 
college students found that high school graduates with a higher grade point average were less likely to be 
identified as unprepared for credit-bearing coursework upon enrollment in a community college (Center for 
Community College Student Engagement, 2016). 


Studies on the ability of state standardized test scores to predict college readiness have often found these tests 
to be a rigorous and valid yardstick for measuring student achievement and ability that translate into college 
success outcomes (Atkinson & Geiser, 2009; Porter & Polikoff, 2012; Wiley et al., 2010). Students in Palau take the 
locally designed Palau Achievement Test, which is administered during the spring semester of grades 4, 6, 8, 10, 
and 12 in English, Palauan studies, science, math, and social studies. The test results, reported as the percentage 
of questions that students answered correctly, are used to assess instructional effectiveness and whether 
students are meeting learning targets. 


Other types of high school coursework have also been found to predict college outcomes. Participation in dual- 
enrollment courses (courses for which students can earn both high school and college credit) has also been found 
to be positively related to college outcomes such as enrollment, persistence, and grade point average (Hein et al., 
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2013; Karp et al., 2007), including specifically for students entering two-year colleges (Fink et al., 2017). A variety 
of studies have found evidence that participation in career and technical education is positively related to college 
enrollment and to earning a postsecondary degree (Cellini, 2006; DeLuca et al., 2006; Fletcher & Zirkle, 2009; Karp 
& Hughes, 2008; Reese, 2008). 


Being able to effectively use and understand the language of instruction is an important aspect of college 
readiness (Garcia et al., 2008). In Palau a majority of public school students start their education in kindergarten 
as monolingual speakers of Palauan. Throughout the K-12 education system, students are instructed in both 
Palauan and English, but at Palau Community College instruction is only in English. Students who have not 
achieved an adequate level of English fluency might have worse academic outcomes in courses taught in English 
than students without such linguistic barriers (Garcia et al., 2008). In addition to results on English language 
proficiency assessments, student performance in high school English courses can be an indicator of English 
language fluency. 


Other student characteristics as control variables 


Along with high school academic preparation, this study considered other student characteristics as possible 
predictors of students’ early college success or college completion. While these student characteristics are mostly 
fixed, understanding the factors that predict postsecondary success—and those that do not—can motivate 
educators and administrators to take steps to better meet the needs of students. U.S. studies have found gender 
to be predictive of students’ college success (Aud et al., 2010, 2011; Ross et al., 2012). For example, Ross et al. 
(2012) found that, for nearly every year over the past four decades, a lower percentage of male students than of 
female students enrolled in college and eventually graduated. Race/ethnicity’ may also be associated with 
students’ likelihood of succeeding in college (Musu-Gillette et al., 2017). A study of educational attainment data 
disaggregated by Asian American and Pacific Islander populations found lower rates of attainment of a bachelor’s 
degree among Southeast Asian American and Pacific Island Nation populations in the United States than among 
the total U.S. population (Museus, 2013). Variation in student outcomes within an institution has also been found 
by college cohort, because of a variety of factors including variation in faculty members, academic policies and 
curricula, and student generational differences. Education research studies frequently control for college cohort 
to account for variation attributed to these factors (Hodara & Cox, 2016; Stoker et al., 2018). 
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Appendix B. Methods 


This appendix describes the study data and data sources and the steps used to link the data and ensure their 
accuracy. 


Data sources 

Data for the study were provided by the Palau Ministry of Education and Palau Community College. The Palau 
Ministry of Education provided student-level data for all Palau High School students who graduated between 
spring 2013 and spring 2017; however, the analysis was restricted to the 387 students in the first three college 
cohorts of graduates (spring 2013, spring 2014, and spring 2015) because students in the 2016 and 2017 college 
cohorts had not been in college long enough to record their status on all three community college outcomes. 


Palau Ministry of Education. The Palau Ministry of Education securely transmitted the raw Palau High School 
datasets electronically to the study team in two tab-delimited text files: 


e Student enrollment, graduation, grade point average, and assessment results, which included Palau High 
School student identification information; Palau High School graduation date; demographic data on gender, 
race/ethnicity, and nationality;? Palau High School grade point average; and Palau Achievement Test English 
and math scores. 


e Student course transcripts, which included Palau High School student identification information, school year 
and grade in which a student enrolled in each course, course name, and grade each student earned in the 
course. 


Palau Community College. Palau Community College provided student-level data for all Palau High School 
graduates who enrolled in Palau Community College between fall 2013 and fall 2018 and who enrolled in at least 
one credit-bearing course in their first semester. Raw data from Palau Community College were securely 
transmitted electronically to the study team as a single Microsoft Excel file with six worksheets, the following 
four of which included information pertaining to the current study: 


e Student enrollment and demographic characteristics, which included students’ Palau Community College 
identification number, name, Palau High School graduation date, Palau Community College enrollment cohort, 
term of first enrollment in Palau Community College, Palau Community College graduation date, major, 
degree earned, demographic data (gender, race/ethnicity, and nationality), date of birth,? grade point average 
in the first year, and retention to a second year. 


e Credits attempted and earned per semester, which described the total number of credits earned in each 
semester in which a student was enrolled in Palau Community College. 


e First-semester course placement, which described the first math and English course in which students were 
placed upon enrollment at Palau Community College. 


e Student course transcripts, which described the course, grade earned, and number of credits in each course 
a student took at Palau Community College. 


2 Race/ethnicity and nationality were not used in the analysis because there was very little variation. 
3 Age was not used in the analysis because there was very little variation. 
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Data linking and merging 

Linking students’ high school data records to their college data records required several steps. The Palau Ministry 
of Education and Palau Community College provided unique student identification numbers in their raw data files. 
These identification numbers allowed for all high school datasets to be linked and all college datasets to be linked. 
However, because the identification numbers were unique to the two separate institutions, this did not allow for 
direct merging between the Palau Ministry of Education data and Palau Community College data. 


The Palau Ministry of Education and Palau Community College provided student identifying information, including 
first, middle, and last names and birthdates, that enabled linking. Manual correction was sometimes needed to 
ensure proper linking. Student data in some datasets included additional suffixes or middle initials instead of full 
names. When this occurred, names were compared manually for similar birthdates and high school graduation 
dates, which were then used to link across the data files. While this process was successful in linking all Palau 
Community College students with a Palau High School graduation date, this matching approach could have 
introduced some error. 


After the Palau Ministry of Education data and Palau Community College data were linked, the linked data were 
restructured so that each student’s high school and community college data were included in one row (rather 
than in several rows, as in some of the datasets received by the study team). 


In total, the dataset included 387 students who graduated from Palau High School from spring 2013 through spring 
2015, of which 234 students (61 percent) enrolled in one of the three Palau Community College cohorts studied 
(fall 2013 through fall 2015). The remaining 153 students were designated as nonenrollees. This group included 
all Palau High School graduates for whom there were no records of enrollment in the Palau Community College 
datasets and students who enrolled in Palau Community College later than the fall semester after their spring 
graduation from Palau High School.* Most of the analyses used only the data for the 234 Palau High School 
graduates who enrolled in Palau Community College in the fall semester following their spring graduation from 
Palau High School and thus for whom data were available on the three college success outcomes of interest. 
However, the full dataset was used to explore whether there were observable differences in academic preparation 
and student characteristic variables between Palau Community College enrollees and nonenrollees (see figure B1 
later in this appendix and table C1 in appendix C). 


Data processing and cleaning 
This section describes the process used to generate the final analytic data file used in the analysis. 


Reviewing high schoo! data. The study team received high school datasets with data on courses and demographic 
characteristics for students who enrolled in Palau High School as far back as 2007. This included records for 387 
students at Palau High School who graduated in the spring of 2013, spring of 2014, and spring of 2015, as these 
students could conceivably have enrolled in Palau Community College in the fall college cohorts examined. 


The course information included enrollment and performance records for each Palau High School course, with 
each row containing information on a single course in which a student was enrolled while at Palau High School. 
These records were available for all 387 students for whom data on student characteristics were also available 
and were included in the next phase of data cleaning. 


Addressing missing data. After merging the Palau Ministry of Education and Palau Community College datasets 
and restricting the resulting dataset to the three college cohorts of interest, the study team calculated the 


4 Six students were reclassified as nonenrollees because their enrollment in Palau Community College occurred a year or more after their 
graduation from Palau High School; 238 students who were included in the enrollment files from Palau Community College but did not 
have a listed Palau High School graduation date in the files provided by Palau High School were excluded from the analysis. 
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percentage of students with missing records for each of the dependent and independent variables in the analysis. 
Two variables had missing data: grade point average in the first year of college and high school math grades. For 
college grade point average, the study team calculated values using other data in the dataset. For high school 
math grades, the study team imputed values for the 4.7 percent of the sample with missing data, as described 
below. 


e Grade point average in the first year of college: Of the 234 Palau High School graduates from spring 2013 
through spring 2015 who enrolled in Palau Community College in the fall after graduation, 71 (30 percent) 
had missing data on grade point average in their first year of college. To avoid unnecessarily removing students 
and shrinking an already small sample, the study team calculated the grade point average in the first year of 
college for these students using the course grades and credit information provided by Palau Community 
College. Some 59 of those students (83 percent) were missing data on grade point average because they 
dropped out during or after their first semester, and Palau Community College provided cumulative grade 
point averages only for students who remained enrolled until the end of their first year. All 59 of these 
students had enrolled in courses for at least three credits in their first semester and were enrolled past the 
date where they could drop the class without penalty. Fourteen of the 59 students did not earn any credit, 
and their cumulative grade point average was recorded as 0.0. 


The remaining 45 students earned at least one credit in their first semester. To retain these students in the 
analysis of grade point average and maintain a consistent sample across the outcomes of interest, the study 
team calculated their grade point averages in the first semester of college using the course grades and credit 
information in the dataset received from Palau Community College. This broadened the operational definition 
of grade point average in the first year of college to represent students’ cumulative grade point average for 
all courses attempted within their first two semesters, regardless of whether they dropped out during the 
school year.° An additional 12 students were missing a cumulative grade point average even though they were 
enrolled for the entire first year or longer and had accrued an average of 25 credits over their tenure at Palau 
Community College; their grade point averages were calculated using course-level information in the 
database. 


e High school math course grades: Eleven of the 234 students (4.7 percent) were missing grades for Algebra | 
because they had completed that course in middle school; consequently, their first math course at Palau High 
School was Algebra II (7 students) or Geometry (4 students). All 11 students earned more than 70 percent of 
the possible points (a C or higher) in their more advanced math courses, so they were classified as having met 
the threshold of achieving more than 70 percent of possible points in Algebra |. Students who were missing 
Trigonometry grades were assumed to have opted not to take the advanced math course and were classified 
as students who did not achieve more than 70 percent and therefore did not earn any credits. 


Community college outcome variables 


Grade point average of 2.0 or higher in the first year of college. The first outcome measure is a binary indicator 
equal to 1 for students who achieved a cumulative grade point average of 2.0 or higher in their first two semesters 
at Palau Community College and O for those who did not. The cutpoint of 2.0 was selected because that is the 
minimum grade point average required to graduate with an associate degree or certificate from Palau Community 
College. Cumulative grade point averages were calculated by averaging students’ course grades (measured on a 


5 The correlation between college students’ fall semester grade point average and cumulative first-year grade point average is high (alpha 
= 0.84), which suggests that including students who did not have a spring semester grade point average would not significantly bias findings 
on the relationship between the high school academic preparation variables and students’ grade point average in their first year at Palau 
Community College. 
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4-point scale) in all elective and nonelective courses taken in the first two semesters at Palau Community College. 
The study team used student-level course transcript records provided by Palau Community College to calculate 
students’ cumulative grade point averages. 


Persistence to a second year of college. The second outcome is a binary indicator equal to 1 for students who were 
still enrolled in Palau Community College in the fall semester of the academic year immediately following the 
academic year in which they first enrolled (for example, a student who first enrolled in Palau Community College 
in the fall of 2014 and was still enrolled in the fall of 2015). Students who did not remain enrolled in the fall 
semester after their first year were assigned a 0 value for this outcome. Course enrollment data provided by Palau 
Community College was used to determine students’ status on this outcome measure. 


Completion of an associate degree or certificate within three years. The third outcome measure is a binary 
indicator equal to 1 for students who completed an associate degree or certificate within three years (36 months) 
of first enrollment. Data provided by Palau Community College included information on students’ date of first 
enrollment and date of graduation from a degree or certification program at Palau Community College. Students 
who did not remain enrolled in the fall semester after their first year along with students who did not complete a 
degree or certificate within three years were assigned a O value for this outcome. 


High school academic preparation variables 

This section describes the high school academic preparation variables that are used in the analysis to predict the 
three community college success outcomes. The Palau Ministry of Education provided the student-level data 
required to construct these variables. 


High school grade point average. High school grade point average for Palau High School students is reported ona 
conventional 4-point scale. Grade point averages were reported directly by the Palau Ministry of Education and 
are based on an unweighted average of all course grades, elective and nonelective, received in grades 9-12. 


Palau Achievement Test. The Palau Ministry of Education provided student-level English language arts and math 
scores on the grade 12 Palau Achievement Test. Scores were reported as the percentage of questions answered 
correctly (0-100). The locally designed Palau Achievement Test is administered during the spring semester of 
grades 4, 6, 8, 10, and 12 in English, Palauan studies, science, math, and social studies. The results are used in 
assessing instructional effectiveness and identifying students who are meeting learning targets and those who are 
not.6 


English course grades. Five variables identified the English courses in which a student enrolled in Palau High School 
and achieved a grade of Cor higher. As of 2015, the high school graduation year for the study’s most recent cohort, 
Palau High School’s English pathway consisted of English | and English Reading and Writing in grade 9, English II in 
grade 10, English Ill in grade 11, and English IV in grade 12. 


Math course grades. Four variables identified the math courses in which a student enrolled in Palau High School 
and achieved a passing grade of C or higher. As of 2015, the high school graduation year for the study’s most 
recent cohort, the school’s math pathway consisted of Applied Math in grade 9, Algebra | and Algebra II in grade 
10, and Geometry in grade 11. Palau High School does not require math after grade 11 but does offer Trigonometry 
as an elective in grade 12. About 56 percent of Palau High School graduates earned credit in Trigonometry, which 
is lower than for the other math courses in part because it is an elective course. Students who did not enroll in 
Trigonometry were coded as not earning credit. Fewer than 10 percent of students at Palau High School stop their 
math education after Applied Math or Algebra |; therefore, the study team combined these two categories. There 


6 The study team was unable to locate information on the predictive validity of the Palau Achievement Test. 
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was little variation in highest math course completion between Palau High School graduates who enrolled in Palau 
Community College and those who did not (figure B1). 


Figure B1. Little variation in highest math course completed in 2013 through 2015 for Palau High School 
graduates who enrolled in Palau Community College and those who did not 
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Source: Authors’ analyses of data from the Palau Ministry of Education and Palau Community College. 


Palau High School career academy enrollment. A career academy variable was used to indicate the career 
academy in which a Palau High School student was enrolled. Career academies consist of a set of academic and 
vocational courses that are closely aligned to the main industries in Palau. All students in Palau High School must 
enroll in one of seven career academies, which focus on agriculture, health pathways, business information, 
automotive technology, construction technology, tourism and hospitality, and liberal arts (college preparatory). 
Construction and liberal arts were the most popular academies; each was selected by 23 percent of students in 
the 2013-15 cohorts. 


Student characteristics 

Gender. The student’s gender is a binary indicator coded as male or female based on the data provided by Palau 
High School. Slightly more Palau High School graduates who enrolled in Palau Community College were female 
(126, or 54 percent) than male (108, or 46 percent). 


Nationality and race/ethnicity. The study had access to nationality and race/ethnicity data for Palau High School 
graduates. However, because 4 percent or fewer students were listed with a race/ethnicity or nationality other 
than Palauan, these variables were not used in the study’s analyses. 


College cohort. The college cohort used in this study represents the semester in which graduates from Palau High 
School enrolled in Palau Community College. The college cohorts were coded as fall 2013, fall 2014, or fall 2015 
for Palau High School graduates in spring 2013, spring 2014, and spring 2015. Of the 234 Palau High School 
graduates who enrolled in Palau Community College, 96 (41 percent) were in the fall 2013 cohort, 66 (28 percent) 
in the fall 2014 cohort, and 72 (31 percent) in the fall 2015 cohort. 


Methodology 

The analysis was designed to identify a set of indicators that educators at Palau High School could use to assess 
their students’ college readiness and intervene to increase the likelihood that all students would be prepared to 
succeed academically at Palau Community College and complete an associate degree or certificate within three 
years. The analytic strategy for the study included descriptive analyses and logistic regression analyses of the 
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relationship between the academic preparation and student characteristic variables and the three college success 
outcomes. 


The first step of the analysis was to compare high school academic preparation variables and the other student 
characteristics between Palau Community College enrollees and nonenrollees among all Palau High School 
graduates from spring 2013 through spring 2015. For continuous variables (for example, English language arts and 
math scores on the grade 12 Palau Achievement Test), the study team tested the statistical significance of the 
difference in means of enrollees and nonenrollees using t-tests. For categorical variables (for example, gender), 
statistical significance was assessed using p-values from chi-squared tests. The only statistically significant 
difference between Palau High School graduates who enrolled in Palau Community College and those who did not 
was that enrollees had higher rates of earning a grade of C or higher in English IV at Palau High School than 
nonenrollees. The results of this analysis are shown in table C1 in appendix C. 


The second step was to examine the prevalence of each of the three outcome variables among Palau High School 
graduates who enrolled in Palau Community College. 


The final step was to conduct logistic regression analyses to identify the high school academic preparation and 
student characteristic variables that were statistically significant predictors of each community college outcome. 
Separate logit models were run for each of the three outcomes. The generic form of the logit models is as follows: 


logit(Pr[Y; = 1| Z;, X;]) = log (; =>) =at+PyX+BzZ+C 
U 

where the outcome logit(Pr[Y; = 1] Z;,X;]) is the log odds of a binary outcome measure Y; of early college 
success for the student achieving the college success measure. For example, in the model predicting earning a 
grade point average in the first year of college, Y = 1 for students with a grade point average of 2.0 or higher and 
Y = 0 for students with a grade point average below 2.0. The binary outcome is transformed into the log of the 
odds ratio using the logit link function, where p is the probability that the outcome is equal to 1 for a given set of 
predictor variables [p;= Pr(Y¥;= 1|Z,X;)], X is the vector of the other student characteristic (gender), Z is the vector 
of high school academic preparation variables that correspond with coefficients 6,, C is the cohort fixed effects 
that capture constant differences in the outcomes across the three cohorts of Palau Community College enrollees, 
and ais a constant (intercept) that represents the grand mean. Categorical predictor variables in the model were 
coded using deviation coding (University of California Los Angeles Statistical Consulting Group, 2011) to compare 
each level of the predictor variable to the grand mean, which is a proxy for the general population average. With 
deviation coding, binary predictor variables were coded as 1 and —1. For categorical variables with three or more 
levels, a dummy variable was created and coded for the number of levels minus 1, as in the example in table B1. 
The regression beta for dummy variable 1 would indicate the results of the level 1 of the example variable 
compared with the grand mean, while the results for dummy variable 2 would be for level 2 compared with the 
grand mean. 


Table B1. Example deviation coding for categorical variable with three levels 


Example variable Dummy variable 1 Dummy variable 2 
Level 1 1 0 
Level 2 0 1 
Level 3 —1 -1 


Source: Authors’ creation. 
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Continuous variables were centered around their mean value to increase interpretability of the model’s intercept. 
Logistic regression models were calculated using the R statistical language (R Core Team, 2019) version 3.5.3. 


Of interest are the magnitudes and statistical significance of the coefficients for the variables in vector Z (and, to 
a lesser extent, X). Coefficients are reported as odds ratios in tables C3—C5 in appendix C, along with their 95 
percent confidence intervals and statistical significance (p-values). Tests for specification error and goodness of 
fit were conducted for all models, and their results are presented in the notes for tables C3—-C5. All three logistic 
regression models were also tested to ensure that they met the model’s assumptions, and all predictors had 
variance inflation factors of less than 4, indicating low multicollinearity of the predictor variables. 


Tables C6—-C8 in appendix C report the predicted probabilities for the high school academic preparation variables 
and the student characteristic (gender and college cohort) control variables. For continuous variables these values 
indicate the predicted probability of achieving the outcome at different points along the range of the variable, 
while holding other continuous predictor variables at their mean values and while averaging across all levels of 
categorical variables. For categorical variables such as gender, the predicted probability shows the predicted 
probability for each level of the predictor, while holding continuous predictor variables at their mean values and 
while averaging across all levels of the other categorical variables. The predicted probabilities were calculated 
using the R package emmeans (Length, 2020). 
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Appendix C. Supporting analyses 


This appendix provides supporting analyses for this study. Tables C1 and C2 report descriptive statistics for the 
sample. Table C1 lists means for continuous variables and percentages for categorical variables for all Palau High 
School graduates in the original dataset as well as for Palau High School graduates who enrolled in Palau 
Community College (the main sample for the study). The only statistically significant difference in the distributions 
for the predictor variable between Palau High School graduates who enrolled in Palau Community College and 
those who did not was that Palau Community College enrollees had higher rates of earning a grade of C or higher 
in English lV at Palau High School. In addition, 48 percent of students in the Liberal Arts Career Academy at Palau 
High School did not enroll in Palau Community College. Because this is a college preparatory academy, it is possible 
that some of those students enrolled in a college abroad. Data were not available on college enrollment outside 
of Palau for Palau High School graduates. Table C2 provides additional descriptive statistics for the continuous 
variables used in this study. 


Tables C3—C5 report the results for the logistic regression models for each of the three college success outcome 
variables in the study. Tables C6—C8 report the predicted probabilities for the high school academic preparation 
and student characteristic variables from the logistic regression models. Details on how the models were 
calculated are in appendix B. 


Slightly more than half (54 percent) of Palau High School graduates who enrolled in Palau Community College 
were women, and slightly less than half (46 percent) were men. About 55 percent of Palau High School graduates 
who enrolled in Palau Community College in 2013 through 2015 completed Trigonometry, the highest math course 
offered at Palau High School. Across the three cohorts of Palau High School graduates who enrolled in Palau 
Community College, the average high school grade point average was 3.06 and the average grade 12 Palau 
Achievement Test score was 42 in English language arts and 29 in math (on a scale of 0-100). The most popular 
career academies for Palau High School graduates who enrolled in Palau Community College were Construction 
Technology and Liberal Arts, at 23 percent each. 
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Table C1. High school academic preparation variables and other student characteristics of Palau Community 
College enrollees and nonenrollees among all Palau High School graduates from spring 2013 through spring 
2015 


Palau Community College 


Difference 
between 
All Palau High enrollees and 
School nonenrollees 
graduates Enrollees Nonenrollees (percentage 
WETar] (=) (percent) (percent) (percent) points) 


All students 100.0 60.5 39.5 


High school academic preparation 

Grade 12 Palau Achievement Test (mean score) 

English language arts 42.2 41.6 43.5 _ .245 
Math 29.6 29.4 29.9 - 553 


English language arts course grade of C or higher (mean percentage of points earned) 


English | 85.3 86.3 83.7 2.6 564 
English Reading and Writing 83.2 84.6 81.0 3.6 436 
English II 78.4 79.5 76.8 2.7 .621 
English III 91.0 92.7 88.2 4.5 .184 
English IV 86.0 91.5 77.6 13.9 <.001* 
Math course grade of C or higher (mean percentage of points earned) 

Algebra | 84.0 84.6 83.0 1.6 779 
Algebra Il 79.8 79.9 79.7 0.2 .999 
Geometry 80.6 80.8 80.4 0.4 .999 
Trigonometry 55.0 55.1 54.9 0.2 .999 
High school grade point average (mean) 

High school grade point average 3.04 3.06 3.00 _ 366 
Career academy (percent of total enrollment) 

Natural Resources—Agriculture 4.9 4.3 5.9 1.6 .634 
Health & Human Services—Health 44 4.3 4.6 0.3 .999 
Pathway 

Business Information 12.4 12.4 12.4 0.0 .999 
Industrial Engineering—Automotive 14.2 15.4 12.4 3.0 504 
Technology 

Health & Human Services—Tourism & 15.8 18.4 11.8 6.6 .109 
Hospitality 

Industrial Engineering—Construction 22.0 22.6 20.9 1.7 .782 
Technology 


Liberal Arts 26.4 22.6 32.0 9.4 .054 


Palau Community College 


Difference 
between 


All Palau High enrollees and 
School nonenrollees 
graduates Enrollees Nonenrollees (percentage 
NETar] ) (21 (percent) (percent) (percent) points) p-value? 


Student characteristic 


Gender 
Female 55.0 53.8 56.9 3.1 .436 
Male 45.0 46.2 43.1 3.1 .436 


Palau High School graduation cohort 


Spring 2013 38.0 41.0 33.3 7.7 .156 
Spring 2014 31.5 28.2 36.6 8.4 .104 
Spring 2015 30.5 30.8 30.1 0.7 973 
Total number of students 387 234 153 na na 


*Significant at p < .05. 

— is not applicable for continuous variables; na is not applicable. 

a. Indicates whether the difference in academic performance and student characteristic variables between Palau Community College enrollees and 
nonenrollees is statistically significant. Statistical significance was measured by t-tests for continuous variables and chi-squared tests for categorical variables. 
Note: Percentages may not sum to 100 because of rounding. 

Source: Authors’ analyses of data from the Palau Ministry of Education and Palau Community College. 


Table C2. Descriptive statistics for continuous variables for Palau High School graduates in spring 2013 
through spring 2014 who enrolled in Palau Community College in the fall after graduation 


Standard 

Continuous variable Median deviation Minimum Maximum 

English language arts score on the grade 12 Palau 41.6 39.1 15.17 14.1 90.2 

Achievement Test 

Math score on the grade 12 Palau Achievement 29.4 27.9 747 88 55.9 

Test 

High school grade point average 3.06 3.1 0.56 1.6 4.0 
Note: n = 234. 


Source: Authors’ analyses of data from the Palau Ministry of Education and Palau Community College. 


Table C3. Results of logistic regression model predicting earning a grade point average of 2.0 or higher in the 
first year of college for Palau High School graduates in spring 2013 through spring 2014 who enrolled in Palau 
Community College in the fall after graduation 


95 percent 
confidence 


Variable (ole (elwe-hale) interval 


High school academic preparation 


Grade 12 Palau Achievement Test (mean centered) 


English language arts 1.01 0.98-1.03 .509 
Math 1.05 1.00-1.11 .037* 
English language arts course grade of C or higher 

English | 1.02 0.62-1.65 947 
English Reading and Writing 0.92 0.59-1.44 713 
English II 1.30 0.86-1.97 .214 
English Ill 0.78 0.43-1.46 423 
English IV 1.50 0.85-2.79 .176 
Math course grade of C or higher 

Algebra | 1.08 0.66-1.77 765 
Algebra II 0.83 0.51-1.32 432 
Geometry 1.17 0.76—1.83 475 
Trigonometry 1.22 0.81-1.82 .332 
High school grade point average (mean centered) 

High school grade point average 3.34 1.33-8.83 .012* 
Career academy 

Natural Resources—Agriculture 1.20 0.31-4.86 .794 
Health & Human Services—Health Pathway 2.66 0.53-34.75 314 
Business Information 0.76 0.31-1.88 .540 
Industrial Engineering—Automotive Technology 1.16 0.50-2.66 729 
Industrial Engineering—Construction Technology 0.84 0.40-1.72 .630 
Health & Human Services—Tourism & Hospitality 0.67 0.31-1.40 .287 
Liberal Arts 0.64 0.30-1.32 .233 
Student characteristic 

Gender 

Female 0.85 0.58-1.22 372 
Male 1.18 0.82-1.73 372 
College cohort 

Fall 2013 0.72 0.46-1.14 .166 
Fall 2014 1.70 1.04—2.83 .038* 
Fall 2015 0.81 0.51-1.31 398 
Constant (grand mean) 1.62 0.60-4.33 .336* 


*Significant at p < .05. 
Note: n = 234. Results are based on logistic regression analysis. Tjur’s R? = .230. 
Source: Authors’ analyses of data from the Palau Ministry of Education and Palau Community College. 
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Table C4. Results of logistic regression model predicting persistence to a second year of college for Palau High 
School graduates in spring 2013 through spring 2014 who enrolled in Palau Community College in the fall after 
graduation 


95 percent 


confidence 
Variable Odds ratio interval 


High school academic preparation 


Grade 12 Palau Achievement Test (mean centered) 


English language arts 0.98 0.96-1.01 .215 
Math 1.04 1.00-1.09 .056 
English language arts course grade of C or higher 

English | 1.52 0.93-2.53 .097 
English Reading and Writing 0.96 0.61-1.52 .872 
English II 1.34 0.89-2.05 .169 
English III 1.33 0.69-2.77 414 
English IV 1.91 1.03-3.81 .049* 
Math course grade of C or higher 

Algebra | 1.17 0.71-1.94 534 
Algebra Il 0.67 0.41-1.08 .110 
Geometry 1.24 0.80—-1.96 .338 
Trigonometry 1.41 0.94—2.12 .099 
High school grade point average (mean centered) 

High school grade point average 1.16 0.47-2.85 .747 
Career academy 

Natural Resources—Agriculture 1.58 0.43-6.30 .496 
Health & Human Services—Health Pathway 2.73 0.57-34.89 .292 
Business Information 0.52 0.22-1.20 .126 
Industrial Engineering—Automotive Technology 1.32 0.57-3.03 .509 
Industrial Engineering—Construction Technology 0.39 0.19-0.79 .010* 
Health & Human Services—Tourism & Hospitality 0.76 0.36-1.57 .467 
Liberal Arts 1.13 0.55-2.32 .738 
Student characteristic 

Gender 

Female 0.97 0.69-1.37 881 
Male 1.03 0.73-1.46 881 
College cohort 

Fall 2013 0.78 0.50-1.21 .271 
Fall 2014 1.26 0.80—2.02 329 
Fall 2015 1.02 0.64—-1.63 950 
Constant (grand mean) 0.46 0.15-1.28 151 


*Significant at p < .05. 
Note: n = 234. Results are based on logistic regression analysis. Tjur’s R? = .207. 
Source: Authors’ analyses of data from the Palau Ministry of Education and Palau Community College. 
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Table C5. Results of logistic regression model predicting completion of an associate degree or certificate 
within three years for Palau High School graduates in spring 2013 through spring 2014 who enrolled in Palau 
Community College in the fall after graduation 


95 percent 
confidence 


Variable Odds ratio interval 


High school academic preparation 


Grade 12 Palau Achievement Test (mean centered) 


English language arts 0.98 0.95-1.01 .205 
Math 1.04 0.98-1.09 .167 
English language arts course grade of C or higher 

English | 3.45 1.31-16.14 .037* 
English Reading and Writing 0.61 0.32-1.19 .130 
English Il grade 0.91 0.46-1.86 781 
English Ill grade 0.44 0.17-1.34 113 
English IV grade 1.31 0.57-3.71 551 
Math course grade of C or higher 

Algebra | 0.80 0.39-1.74 555 
Algebra II 0.99 0.47-2.24 982 
Geometry 2.01 0.89-5.79 .132 
Trigonometry 1.01 0.58-1.78 .972 
High school grade point average (mean centered) 

High school grade point average 5.27 1.47-21.41 .015* 
Career academy 

Natural Resources—Agriculture 3.72 0.79-16.50 .081 
Health & Human Services—Health Pathway 1.31 0.30-4.97 .699 
Business Information 1.28 0.51-3.07 588 
Industrial Engineering—Automotive Technology 0.98 0.36-2.56 971 
Industrial Engineering—Construction Technology 0.22 0.06-0.61 .008* 
Health & Human Services—Tourism & Hospitality 1.01 0.43-2.27 .979 
Liberal Arts 0.73 0.31-1.63 458 
Student characteristic 

Gender 

Female 0.73 0.46-1.13 157 
Male 1.38 0.89-2.16 157 
College cohort 

Fall 2013 1.00 0.56-1.76 993 
Fall 2014 1.27 0.71-2.25 406 
Fall 2015 0.79 0.43-1.40 423 
Constant (grand mean) 0.14 0.02-0.58 .015* 


*Significant at p < .05. 
Note: n = 234 Results are based on logistic regression analysis. Tjur’s R? = .185. 
Source: Authors’ analyses of data from the Palau Ministry of Education and Palau Community College. 
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Table C6. Predicted probabilities of achieving each college success outcome by student characteristics for 
Palau High School graduates in spring 2013-spring 2014 who enrolled in Palau Community College in the fall 
after graduation 


Completion of an 


Grade point average associate degree or 
of 2.0 or higher in the Persistence to certificate within 
Student characteristic first year of college LX=Yoro} ale MY{=y-] mre) mere) | (-1:4-1 three years 
Gender 
Male .657 323 .161 
Female 577 311 .092 


College cohort 


Fall 2013 539 .266 122 
Fall 2014 733 3691 .150 
Fall 2015 .569 320 .099 


Note: n = 234. See appendix B for a description of how the predicted probabilities were calculated. 
Source: Authors’ analyses of data from the Palau Ministry of Education and Palau Community College. 


Table C7. Predicted probabilities of achieving each college success outcome by high school academic 
preparation variable for Palau High School graduates in spring 2013-spring 2014 who enrolled in Palau 
Community College in the fall after graduation 


Completion of an 
Grade point average associate degree or 


of 2.0 or higher in the Persistence to certificate within 
NETar-) 9) (-3 first year of college LX=Yoro) aCe MY{=r-] melee) | (2:42) three years 


English language arts score on the grade 12 Palau Achievement Test 


0 531 .467 .244 
5 542 448 .226 
10 552 .430 .209 
15 563 411 193 
20 573 393 177 
25 584 375 .163 
30 594 357 .150 
35 .604 .339 137 
40 .615 323 126 
45 625 306 115 
50 .635 .290 105 
55 .644 275 .096 
60 .654 .260 .087 
65 .664 245 .080 
70 .673 .231 .072 
75 .682 .218 .066 
80 .692 .205 .060 
85 701 193 .054 
90 .709 .182 .049 


95 718 .170 .045 


Completion of an 


(ef ¢-Te (<M ele) fal ar-\Vi=1 ¢-1-4-) associate degree or 
of 2.0 or higher in the Persistence to certificate within 

NWETat-) 9) {=} first year of college LX=Yoro} aCe MYL=r-] melee) |(-1:4-1 three years 
100 727 .160 041 
Math score on the grade 12 Palau Achievement Test 

0 .264 114 .046 

5 .316 .1381 .054 

10 374 .166 .064 

15 .436 .198 .076 

20 499 235 .090 

25 563 .277 .106 

30 625 323 124 

35 .683 372 145 

40 735 424 .169 

45 .782 478 .196 

50 .823 .533 .226 

55 857 587 .260 

60 .886 .639 .296 

65 .909 .687 335 

70 928 .732 376 

75 943 .773 420 

80 956 .809 464 

85 965 841 510 

90 973 .868 555 

95 979 891 599 
100 .984 .910 641 


English language arts course grade 


English | C or higher .622 414 324 
English | lower than C .614 .234 .039 
English Reading and Writing C or higher 598 .309 .078 
English Reading and Writing lower than C .637 325 .186 
English Il C or higher .677 384 .112 
English Il lower than C 554 .257 .133 
English Ill C or higher 558 381 .058 
English III lower than C .675 .259 .238 
English IV C or higher .708 .470 .154 
English IV lower than C 518 .195 .096 


Completion of an 
(ef ¢-Te(<M ele) fal ar-\ Y=) ¢-1-4-) associate degree or 


of 2.0 or higher in the Persistence to certificate within 
NETat-) 9) (=) first year of college LX=Yoro} aCe MY{=y-] melee) | (21:42) three years 


Math course grade 


Algebra | C or higher .635 .352 .100 
Algebra | lower than C .600 .284 .148 
Algebra II C or higher 572 .239 121 
Algebra II lower than C .661 .408 .123 
Geometry C or higher .655 366 .218 
Geometry lower than C .580 .272 .064 
Trigonometry C or higher .663 395 .123 
Trigonometry lower than C 570 .248 121 
English language arts course grade 

English | C or higher .622 414 324 
English | lower than C .614 .234 .039 
English Reading and Writing C or higher 598 .309 .078 
English Reading and Writing lower than C .637 325 .186 
English Il C or higher .677 384 .112 
English Il lower than C 554 .257 .133 
English Ill C or higher 558 381 .058 
English Ill lower than C .675 .259 .238 
English IV C or higher .708 .470 .154 
English IV lower than C 518 .195 .096 
High school grade point average 

1.3 .162 .264 .007 
1.7 .238 .275 .014 
2.0 310 .284 .023 
2.3 392 .293 .038 
2.7 511 306 .071 
3.0 .600 315 111 
3.3 .683 325 171 
3.7 777 .338 .286 
4.0 834 348 .398 


Note: n = 234. See appendix B for a description of how the predicted probabilities were calculated. 
Source: Authors’ analyses of data from the Palau Ministry of Education and Palau Community College. 


Table C8. Predicted probabilities of achieving each college success outcome by Palau High School Career 
Academy for Palau High School graduates in spring 2013-spring 2014 who enrolled in Palau Community 
College in the fall after graduation 


Grade point average Completion of an 


of 2.0 or higher in Persistence to associate degree or 
the first year of second year of certificate within 

WETar]o)(-1 Coto) |(=¥:4) Coo) |{=¥=4-) three years 
Career academy 

Natural Resources—Agriculture .659 423 341 
Health & Human Services—Health Pathway 811 559 .154 
Business Information .550 .194 151 
Industrial Engineering—Automotive Technology .652 .380 .120 
Industrial Engineering—Construction Technology 575 .154 .030 
Health & Human Services—Tourism & Hospitality .520 .262 123 
Liberal Arts .509 344 .092 


Note: n = 234. See appendix B for a description of how the predicted probabilities were calculated. 
Source: Authors’ analyses of data from the Palau Ministry of Education and Palau Community College. 


Appendix D. Other analyses 


This appendix provides information about differences in high school academic preparation and gender across the 
Palau Community College cohorts in this study. This analysis was conducted because college cohort was identified 
as a significant predictor of earning a grade point average of 2.0 or higher in the first year at Palau Community 
College (see table C3 in appendix C). Table D1 lists differences in high school academic preparation and student 
characteristic (gender) variables across cohorts. Table D2 provides percentage for each college cohort for 
significant categorical variables shown in table D1. Table D3 and figure D1 give summary statistics for continuous 
variables by college cohort. 


The college cohorts vary by the percentage of students who passed Algebra II, with significantly fewer students 
passing it in the 2014 cohort. In the 2013 cohort no students enrolled in the Health & Human Services—Health 
Pathway Career Academy. The 2014 cohort had significantly fewer students enrolled in the Business Information 
Career Academy than the other two cohorts. The 2015 college cohort had significantly lower grade 12 Palau 
Achievement Test scores for English language arts than the other two cohorts. 


Table D1. High school academic preparation and student characteristics variables for Palau High School 
graduates in spring 2013-—spring 2014 who enrolled in Palau Community College in the fall after graduation 


NETar] ¢)(-) Statistic? »° Degrees of freedom p-value* 


Academic preparation 

Grade 12 Palau Achievement Test score 

English language arts 15.96° 2 <.001* 
Math 0.207° 2 813 


English language arts course grade of C or higher 


English | 1.619? 2 445 
English Reading and Writing 0.141° 2 .932 
English II 0.471 2 .790 
English Ill 6 - 566 
English IV 0.956? 2 .620 
Math course grade of C or higher 

Algebra | 0.861° 2 .6501 
Algebra Il 6.029 2 .0491* 
Geometry 0.839° 2 .6575 
Trigonometry 1.658? 2 4364 
High school grade point average 

High school grade point average 0.731° 2 482 
Career academy 

Natural Resources—Agriculture b - 365 
Health & Human Services—Health Pathway 6 - .0079* 
Business Information 7.042 2 .0296* 
Industrial Engineering—Automotive Technology 15.4? 2 504 
Health & Human Services—Tourism & Hospitality 0.655° 2 721 
Industrial Engineering—Construction Technology 4.876° 2 .0873 
Liberal Arts 0.790° 2 .674 
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EVs] *) (<1 Statistic? »° Degrees of freedom p-value 


Student characteristic 
Gender 0.980? 2 .613 


Note: n = 234. 

a. Chi-squared test using the x? was used to calculate statistical significance. 

b. Fisher Exact Test for Count Data was used to calculate statistical significance. 

c. Analysis of variance using the F-statistic was used to calculate statistical significance. 

d. Indicates whether the difference in academic performance and student characteristic variables between Palau High School cohorts for Palau Community 
College enrollees is statistically significant. 

Source: Authors’ analyses of data from the Palau Ministry of Education and Palau Community College. 


Table D2. Percentage of students in each college cohort for high school academic preparation variables that 
vary significantly by cohort for Palau High School graduates in spring 2013-spring 2014 who enrolled in Palau 
Community College in the fall after graduation 

NETat-) 0) {=} 2013 2014 2015 


Math course grade of C or higher 


Algebra Il 83.3 69.7 84.7 
Career academy 

Health & Human Services—Health Pathway 0.0 i ° 
Business Information 12.5 7 19.4 
Number of observations 96 66 72 


Note: n = 234. Percentages may not sum to 100 because of rounding. Variable differences by cohort are given in table D1. 
a. Cells with 10 students or fewer were suppressed to protect confidentiality. 
Source: Authors’ analyses of data from the Palau Ministry of Education and Palau Community College. 


Table D3. Descriptive statistics for Grade 12 Palau Achievement Test Score for English language arts for Palau 
High School graduates in spring 2013—spring 2014 who enrolled in Palau Community College in the fall after 
graduation 


Standard 
Palau High School cohort Median deviation Minimum Maximum 
2013 47.1 45.0 16.3 20.3 90.2 
2014 41.4 41.6 13.9 14.1 79.7 
2015 34.6 31.3 11.4 18.3 73.4 
Note: n = 234. 


Source: Authors’ analyses of data from the Palau Ministry of Education and Palau Community College. 


Figure D1. Boxplots of grade 12 Palau Achievement Test Scores for English language arts for Palau High School 
graduates in spring 2013-spring 2014 who enrolled in Palau Community College in the fall after graduation 


Grade 12 PAT ELA Score 


2013 2014 2015 
Cohort 


Note: n = 234. The lower horizontal end of the box marks the 25th percentile, the middle marks the median, and the top line marks the 75th percentile; thus 
the box indicates the middle 50 percent of the data’s values (the interquartile range). The top lines extending from the box indicate the 75th percentile plus 
1.5 times the interquartile range, and the bottom lines indicate the 25th percentile minus 1.5 times the interquartile range. Values outside these ranges are 


shown with dots. 
Source: Authors’ analyses of data from the Palau Ministry of Education and Palau Community College. 
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